Web Survey Bibliography
A core tenet of survey research is that the inferences one makes about the population can only be as good as the quality of the respondents in the sample. However, with declines in probability sample response rates and increases in non-probability Internet-based research, researchers have found it increasingly difficult to agree on the quality of a survey sample. Contributing to this difficulty is the variety of research studies that have evaluated the quality of survey data derived from probability-based and non-probability-based sources and the effectiveness of statistical methods to reduce error in data from
these sources. Specifically, some research has documented a greater average error among non-probability samples relative to probability samples (Chang & Krosnick, 2009; Yeager et al., in press), while other research has found few or small differences between the two. Other research has pointed to greater variability in results from surveys non-probability samples of Internet volunteers. For instance, Dedeker (2006) conducted the same study twice on the same Internet survey panel and reached two different business conclusions. An additional study found five to ten times greater variability in error among a sample of seven Internet surveys of non-probability samples versus seven probability sample surveys (Yeager et al., in press). Similarly-sized variability was found in the National Dutch Online Panel Comparison Study. Relatedly, statistical methods such as post-stratification survey weighting have inconsistent effects on non-probability sample surveys, and in some cases increase survey error. It is critically important to synthesize the survey accuracy studies summarized above as well as others. The present study will evaluate the evidence from more than 45 different studies have assessed the accuracy of non-probability sample surveys and the effectiveness of methods to improve their accuracy,
with the aim of helping researchers and consumers to have more informed expectations about data quality in their surveys.
Conference Homepage (abstract)
Web survey bibliography - Internet access Panels (431)
- By the Numbers: Theory of adaptation or survival of the fittest?; 2013; Cavallaro, K.
- Does one really know?: Avoiding noninformative answers in a reliable way.; 2013; de Leeuw, E. D., Boevee, A., Hox, J.
- Sensitive Topics in PC and Mobile Web Surveys; 2013; Mavletova, A. M., Couper, M. P.
- Sampling online communities: using triplets as basis for a (semi-) automated hyperlink web crawler.; 2013; Veny, Y.
- Propensity Score Weighting – Can Personality Adjust for Selectivity?; 2013; Glantz, A., Greszki, R.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Innovation in Data Collection: the Responsive Design Approach; 2013; Bianchi, A., Biffignandi, S.
- Break-off and attrition in the GIP amongst technologically experienced and inexperienced participants...; 2013; Blom, A. G., Bossert, D., Clark, V., Funke, F., Gebhard, F., Holthausen, A., Krieger, U., Wachenfeld...
- Nonresponse and Nonresponse Bias in a Probability-Based Internet Panel; 2013; Blom, A. G., Bossert, D., Funke, F., Gebhard, F., Holthausen, A., Krieger, U.
- Rewards - Money for Nothing?; 2013; Cape, P. J., Martin, P.
- Effects of incentive reduction after a series of higher incentive waves in a probability-based online...; 2013; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Timing of Nonparticipation in an Online Panel: The effect of incentive strategies; 2013; Douhou, S., Scherpenzeel, A.
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Participation and engagement in web surveys of the general population: An overview of challenges and...; 2013; Roberts, C.
- How Do Lotteries and Study Results Influence Response Behavior in Online Panels?; 2013; Goeritz, A., Luthe, S. C.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- Web-based studies: The future in nutritional epidemiology (and overarching epidemiology) for the benefit...; 2012; Hercberg, S.
- Sensitive topics in PC Web and mobile web surveys: Is there a difference? (presentation); 2012; Mavletova, A. M., Couper, M. P.
- (Online) Access Panels: Types and Quality Standards; 2012; Bosnjak, M.
- Passive measurement of online data in Practice - A White Paper Wakoopa; 2012
- Selection bias of internet panel surveys: A comparison with a paper-based survey and national governmental...; 2012; Tsuboi, S., Yoshida, H., Ae, R., Kojo, T., Nakamura, Y., Kitamura, K.
- Screenwise panel: Frequently Asked Questions; 2012
- Research company spotlight - Mobile surveys; 2012
- NBCU enlists Google, ComScore to track multiscreen Olympics viewing; 2012; Spangler, T.
- More dirty little secrets of online panel research.; 2012
- Google et Médiamétrie créent une audience bimédia; 2012; Gonzales, P.
- Especially for You: Motivating Respondents in an Internet Panel by Offering Tailored Questions; 2012; Oudejans, M.
- The war against unengaged online respondents; 2012; Gittelman, S. H., Trimarchi, E.
- By the Numbers: Lessons for using online panels in B2B research; 2012; Elsner, N.
- Recruiting in an Internet panel using respondent driven sampling; 2012; Schonlau, M.
- Multi-Language Multi-Continent B2B Community Panel: How B2B research can effectively span the world; 2012; Morden, M., Accomando, E.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V., Cehovin, G., Kavcic, L., Lenar, J.
- Does survey experience affect respondents’ reported level of satisfaction?; 2012; Schultz Christensen, A., Ladenburg, J.
- Evaluation of an online (opt-in) panel for public participation geographic information systems surveys...; 2012; Brown, G., Weber, D., Zanon, D., de Bie, K.
- Panel Conditioning in Online Survey Panels: Problems of Increased Sophistication and Decreased Engagemeent...; 2012; Adams, A. N., Atkeson, L. R., Karp, J. A.
- Recruiting A Probability Sample For An Online Panel: Effects Of Contact Mode, Incentives, And Information...; 2012; Scherpenzeel, A., Toepoel, V.
- “I think I know what you did last summer” Improving data quality in panel surveys; 2012; Lugtig, P. J.
- Understanding Society Innovation Panel Wave 4: Results from Methodological Experiments; 2012; Burton, J., Budd, S., Kaminska, O., Uhrig, S. C. N., Brown, M., Calderwood, L.
- The Propensity of Older Respondents to Participate in a General Purpose Survey; 2012; Lynn, P.
- Online Data Collection in the Agro-Food Sector; 2012; Biffignandi, S., Artaz, R.
- Effect of different stimulus on data quality in online panels; 2012; Zagar, S., Lozar Manfreda, K.
- The German Internet Panel: First Results from the Recruitment Phases; 2012; Blom, A. G.
- Panel retention rate and data quality: experimental results drawing on Reciprocity design; 2012; Biffignandi, S., Artaz, R.
- Web panels in Slovenia; 2012; Lenar, J., Vehovar, V.
- Innovation in online data collection for scientific research: the Dutch MESS project; 2012; Das, M.
- Professional Respondents in Internet Panels: Who are They and What Do They Do to Our Data?; 2012; de Leeuw, E. D., Matthijsse, S.
- Using Online Panels for National Surveys of Low Incidence Populations: Findings from the CDC Influenza...; 2012; Boyle, J., Ball, S., Ding, H., Srinath, K. P., Euler, G.
- The Persistence of Attentiveness in Web Surveys: A Panel Study; 2012; Berinsky, A., Luks, S., Rivers, D.
- The Effect of Mode on Participant Responses to Qualitative Research in Virtual Worlds; 2012; Dipko, S., Billington, C., Brick, P. D.
- A Systematic Review of Studies Investigating the Quality of Data Obtained with Online Panels; 2012; Callegaro, M., Villar, A., Krosnick, J. A., Yeager, D. S.